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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an inspecting method and 
device for software equivalency capable of automatically performing 
the confirmation (inspection of equivalency) of the existing function of 
a software program to realize the reduction in the work for test 
(including a manual work) and the improvement in quality. 
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same test condition; and the collation step of collating the extraction 
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before change obtained in the test result extracting step as a 
reference with the extraction information extracted from the test 
result of the software program after change for every prescribed test 
item. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the software program equivalency verification approach of verifying the equivalency of the 
software program before modification, and the software program after modification on a computer system The 
test-result extract phase of extracting predetermined information required for verification of equivalency from 
the test result which performed the software program before said modification, and the software program after 
modification under the same test condition, It is based on the extract information extracted from the test 
result of the software program before said modification obtained in said test-result extract phase. The 
software program equivalency verification approach characterized by including the collating phase collated with 
the extract information extracted from the test result of the software program after said modification for 
every predetermined trial item. 

[Claim 2] The extract information extracted from the test result of the software program after said 
modification said collating phase for said every predetermined trial item As opposed to the extract information 
extracted from the test result of the software program after said modification The software program 
equivalency verification approach according to claim 1 characterized by including the phase of judging those 
with equivalency (O.K.) when it is in predetermined tolerance, and judging those without equivalency (NG) when 
there is nothing into predetermined tolerance. 

[Claim 3] Said software program equivalency verification approach is the software program equivalency 
verification approach according to claim 2 characterized by including further the collating result generation 
phase which generates a collating result file including the information as a result of the judgment in said 
collating phase for said every predetermined trial item. 

[Claim 4] Said software program equivalency verification approach is the software program equivalency 
verification approach according to claim 3 characterized by including further the test-result management 
phase which generates the test-result managed table which recorded information including the quality 
(OK/NG) of the test result of all trial items for said every predetermined trial item based on said collating 
result file. 

[Claim 5] In the software program equivalency verification equipment which verifies the equivalency of the 
software program before modification, and the software program after modification A test-result extract 
means to extract predetermined information required for verification of equivalency from the test result which 
performed the software program before said modification, and the software program after modification under 
the same test condition, It is based on the extract information extracted from the test result of the software 
program before said modification obtained with said test-result extract means. Software program equivalency 
verification equipment characterized by providing a collating means to collate with the extract information 
extracted from the test result of the software program after said modification, for every predetermined trial 
item. 

[Claim 6] The extract information extracted from the test result of the software program after said 
modification said collating means for said every predetermined trial item As opposed to the extract information 
extracted from the test result of the software program after said modification The software program 
equivalency verification approach according to claim 5 characterized by judging those with equivalency (O.K.) 
when it is in predetermined tolerance, and judging those without equivalency (NG) further when there is 
nothing into predetermined tolerance. 

[Claim 7] Said software program equivalency verification equipment is the software program equivalency 
verification approach according to claim 6 characterized by including further a collating result generation 
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means to generate a collating result file including the information as a result of the judgment in said collating 
means for said every predetermined trial item. 

[Claim 8] Said software program equivalency verification equipment is the software program equivalency 
verification approach according to claim 7 characterized by including further the test-result management tool 
which generates the test-result managed table which recorded information including the quality (OK/NG) of 
the test result of all trial items for said every predetermined trial item based on said collating result file. 
[Claim 9] The record medium with which the software with which the equipment turns into equipment which 
performs an approach according to claim 1 to 4 by installing in a computer apparatus was recorded and in 
which computer reading is possible. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach and equipment which verify the equivalency of 
the function modification before of the software program concerned, and after modification, when performing 
correction and making a change of a software program. 
[0002] 

[Description of the Prior Art] In recent years, various systems incorporating a software program are used. 
Although there is no request of a functional addition, when a program is changed in consideration of future 
maintenance nature to such a system, in order to check having not affected it out of a modification individual 
reason although the program was changed by functional addition like a rig RESSHON test (degradation trial), it 
is surely needed in the verification test of the existing function. 

[0003] On the other hand, in large systems (telephone switchboard etc.), maintenance and improvement / 
functional addition of a system etc. is repeatedly performed over a long period. Moreover, even if small-scale, 
version up is made in many cases based on the resource with which the operating system and the application 
program were created in the past. For this reason, the program is still more complicated, when the design 
technique of the program included in the system and the structure of software may change with a creation 
time term or implementers and there is a functional addition. By current, by arranging a program, development 
supporting environment is unified and reexamination of software structure is performed for the purpose of 
shortening a design and test time from these things. 

[0004] As mentioned above, when the correction and functional addition of a software program which were 
included in the system are performed, the verification test of the existing function is performed. The normality 
of the function of a software program was checked by examining based on the test procedure manual and the 
data for a trial which were carried out in the past, and conventionally, comparing this test result with the past 
test result (refer to drawing 3 (a)). 
[0005] 

[Problem(s) to be Solved by the Invention] However, the past test result needed to be managed, and grasp of 
detailed requirement specification was needed for the check of a test result, and such an approach had taken 
most time amount. 

[0006] This invention was made in view of the above-mentioned point, can check the existing function of a 
software program automatically (verification of equivalency), and offers the software program equivalency 
verification approach and equipment which realize reduction of the activities for a trial (a human activity is 
included), and improvement in quality. 
[0007] 

[Means for Solving the Problem] The software program equivalency verification approach of this invention In 
the software program equivalency verification approach of verifying the equivalency of the software program 
before modification, and the software program after modification on a computer system The test-result 
extract phase of extracting predetermined information required for verification of equivalency from the test 
result which performed the software program before said modification, and the software program after 
modification under the same test condition, It is characterized by including the collating phase collated with 
the extract information extracted from the test result of the software program after said modification for 
every predetermined trial item on the basis of the extract information extracted from the test result of the 
software program before said modification obtained in said test-result extract phase. 
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[0008] In the software program equivalency verification approach of this invention moreover, said collating 
phase The extract information extracted from the test result of the software program after said modification 
for said every predetermined trial item It is characterized by including the phase of judging those with 
equivalency (O.K.) when it is in predetermined tolerance to the extract information extracted from the test 
result of the software program after said modification, and judging those without equivalency (NG) when there 
is nothing into predetermined tolerance. 

[0009] Moreover, in the software program equivalency verification approach of this invention, it is 
characterized by including further the collating result generation phase which generates a collating result file 
including the information as a result of the judgment in said collating phase for said every predetermined trial 
item. 

[0010] Said software program equivalency verification approach is characterized by including further the test- 
result management phase which generates the test-result managed table which recorded information including 
the quality (OK/NG) of the test result of all trial items for said every predetermined trial item based on said 
collating result file. 

[001 1] The software program equivalency verification equipment of this invention In the software program 
equivalency verification equipment which verifies the equivalency of the software program before modification, 
and the software program after modification A test-result extract means to extract predetermined information 
required for verification of equivalency from the test result which performed the software program before said 
modification, and the software program after modification under the same test condition, It is based on the 
extract information extracted from the test result of the software program before said modification obtained 
with said test-result extract means. It is characterized by providing a collating means to collate with the 
extract information extracted from the test result of the software program after said modification, for every 
predetermined trial item. 

[0012] In the software program equivalency verification equipment of this invention moreover, said collating 
means The extract information extracted from the test result of the software program after said modification 
for said every predetermined trial item It is characterized by judging those with equivalency (O.K.), when it is in 
predetermined tolerance to the extract information extracted from the test result of the software program 
after said modification, and judging those without equivalency (NG) further, when there is nothing into 
predetermined tolerance. 

[0013] Moreover, the software program equivalency verification equipment of this invention is characterized by 
including further a collating result generation means to generate a collating result file including the information 
as a result of the judgment in said collating means for said every predetermined trial item. 
[0014] Moreover, the software program equivalency verification equipment of this invention is characterized by 
including further the test-result management tool which generates the test-result managed table which 
recorded information including the quality (OK/NG) of the test result of all trial items for said every 
predetermined trial item based on said collating result file. 

[0015] Moreover, this invention is a record medium with which the software with which the equipment turns 
into equipment which performs an approach according to claim 1 to 4 was recorded and in which computer 
reading is possible by installing in a computer apparatus. 
[0016] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained with reference 
to a drawing. Drawing 1 is the block diagram showing the configuration of the equivalency verification 
equipment 1 which is the gestalt of 1 operation of the equipment which installed in the computer system the 
software program which consists of a procedure which is the gestalt of 1 operation of the software program 
equivalency verification approach of this invention, or the software program equivalency verification equipment 
of this invention. 

[0017] The outline of the software program equivalency verification approach of this invention is explained 
first The software program equivalency verification approach of this invention uses that the same result will 
be obtained if it examines on the same conditions to the software program before and behind modification 
since there is no modification in the existing function (function in which it does not change), when performing 
modification and a functional addition of a software program. That is, if the same test condition A as the 
software program before and behind modification is inputted as shown in drawing 2 , the test result A of the 
software program before modification and the test result B of the software program after modification will use 
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bringing ,the same result, will perform collating with a test result B by making a test result A into a reference 
value, will judge whether tolerance has a difference, and will verify equivalency of a software program. 
[0018] Contrast with the approach ( drawing 3 (b)) of verification of the equivalency of the software program 
before modification and after modification enforced in equivalency verification equipment 1 by drawing 3 and 
the conventional approach ( drawing 3 (a)) is shown. With equivalency verification equipment 1, in order to 
examine on the same conditions to the software program before and behind modification, grasp of detailed 
requirement specification becomes unnecessary by there being no need of managing the past test result, and 
collating a test result automatically. In addition, although the number of trial items for examining by the 
software program before and behind modification in verifying of the equivalency of the software program 
before modification and after modification doubles compared with the conventional approach, about this, an 
automatic trial is possible and the load of a big activity is not applied. 

[0019] With the gestalt of this operation explained below, since the information (response message etc.) from 
various testing-machine machines, the test atmosphere (workstation), etc. other than the message from a 
system is included in the actual test results A and B, it becomes difficult to compare the test result A used as 
criteria with a test result B simply. Then, the keyword appointed separately extracts data required for 
collating, and actual collating is performed using this extracted data (refer to drawing 4 ). 
[0020] Here, the configuration of equivalency verification equipment 1 is explained. Equivalency verification 
equipment 1 consists of the storage section 2 which memorizes the test result A of the software program 
before modification, and the test result B of the software program after modification, the following test-result 
extract section 3a, collating section 3b, collating result generation section 3c, and the processing section 3 
that consists of 3d of the test-result Management Department. 

[0021] Test-result extract section 3a: From the test result A of the software program before modification, and 
the test result B of the software program after modification, extract based on the keyword which can define 
predetermined information required for verification of equivalency separately, and generate the file which 
consists of extracted information. 

collating — the section — three — b — : — a test result — an extract — the section — three — a — a 
test result — A — from — extracting — having had — an extract — information — A — ' — criteria — ** - 
- carrying out — the same — a test result — B — from — extracting — having had — an extract — 
information — B — ' — collating . At this time, it collates about the checkpoint appointed separately. And 
when extract information B' judges whether it is in predetermined tolerance from extract information A' used 
as criteria and is in predetermined tolerance, those with equivalency (O.K.) are judged, and when there is 
nothing into predetermined tolerance, those without equivalency (NG) are judged. 

[0022] Collating result generation section 3c: Generate a collating result file including the information as a 
result of the judgment by collating section 3b for every trial item. 

3d of test-result Management Department: Generate the test-result managed table which recorded 
information including the quality (OK/NG) of the test result of all trial items for every trial item based on the 
collating result file which collating result generation section 3c generated. 

[0023] In addition, the above-mentioned test result A and a test result B are the results of performing each of 
the software program before modification, and the software program after modification, and examining on the 
basis of the test condition based on the trial item defined separately, and the system of a target. Moreover, it 
changes with systems so that naturally [ predetermined tolerance ], and it defines suitably for every system to 
examine. 

[0024] Moreover, the storage section 2 is constituted by the recording device of the non-volatile of a hard 
disk, a magneto-optic disk, etc. in equivalency verification equipment 1 . Moreover, the processing section 3 
shall be constituted by memory, CPU (central processing unit), etc., and the function shall be realized by 
loading the software program (not shown) for realizing each function of the processing section 3 to memory, 
and performing it Moreover, an input unit, a display, etc. shall be connected to equivalency verification 
equipment 1 as a peripheral device (neither is illustrated). Here, an input device means input devices, such as 
a keyboard and a mouse. A display means things, such as CRT (Cathode Ray Tube) and a liquid crystal display. 

[0025] Next, actuation of the equivalency verification equipment 1 constituted in this way is explained. 

[0026] First, based on a predetermined test procedure manual, the data for a trial predetermined in the system 

top of a target shall be used, the software program before modification and the software program after 
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modification shall be performed, the test result A of the software program before modification and the 
software program test result B after modification shall be obtained, and the examiner shall memorize at the 
storage section 2 of equivalency verification equipment 1 . 

[0027] The telephone switchboard should be used as the target especially in the following explanation. In this 
case, as an example of the file of the above-mentioned test result, a test-result file, a traffic data file, and a 
signal monitoring analysis file are raised. The example of contents of each above-mentioned file is shown in 
drawing 5 -7. 

[0028] First, from a test-result file, test-result extract section 3a extracts predetermined information required 
for verification of equivalency based on keywords, such as "test initiation" and "normal termination", and as a 
result of consisting of such information, it generates a file (refer to drawing 9 ). Similarly, the data file and 
monitor file which consist of predetermined information to each are generated [ data file / traffic ] from a 
signal monitoring analysis file by making "employment information" etc. into a keyword, using "MSGTYPE" etc. 
as a keyword ( drawing 8 : step S1). 

[0029] Next, in step S1, as a result of consisting of information which extracted predetermined information 
based on the keyword, from a file, a data file, and a monitor file, collating section 3b collates about the 
checkpoint shown in drawing 10 , and performs those with equivalency / nothing judgment ( drawing 8 : step 
S2). 

[0030] In the example shown in drawing 10 , two results obtained from the test result of the software program 
after modification before modification, as a checkpoint to a file, it uses "false call normal call origination", "he 
having no urgent / the maximum emergency message output", and "he having no relief of various resources", 
OK/NG is judged, and collating and a judgment are further performed by making an "independence message", 
"various data output information", and "call-processing trace information" into a checkpoint. Similarly, to a 
data file, collating and a judgment are performed by making into a checkpoint "employment information" and 
"traffic information (the time information of an incompleted call (call which was not able to be connected 
normally), a distant-office call identity number, and a local station identification number outside of an object)." 
And to a monitor file, collating and a judgment are performed again by making into a checkpoint "signal 
monitoring information (the speech path acknowledge signal, the distant-office call identity number, and the 
local station identification number outside of an object)" which is the contents of a signal which a telephone 
switchboard receives. 

[0031] In addition, although usually accessed by sending from telephone with the "false normal call origination" 
of a checkpoint to a telephone switchboard, since can prepare all the telephones to send and they cannot be 
examined, it is a checkpoint for checking that it has sent from false equipment normally (call origination) from 
creating the signal of various conditions with the false equipment equivalent to telephone, making it access to 
the exchange, and performing a verification test. 

[0032] Moreover, since it is thought that there is a certain cause when the notice to a maintenance man when 
fault usually occurs to the condition of a telephone switchboard or connection of a telephone, saying a 
checkpoint "has no urgent / the maximum emergency message output" is and this message occurs at the 
time of test implementation, it is a checkpoint for this check. Moreover, although the resource which the 
telephone switchboard was usually performing resource management, such as various memory, saying a 
checkpoint "has no relief of various resources", caught the resource when the software program was 
performed normally, and was caught after processing termination is released, it is a checkpoint for checking 
whether a supplement and disconnection of this resource are made normally. 

[0033] Moreover, if the "independence message" of a checkpoint has some of which the maintenance man 
other than urgent / the maximum emergency message is notified as a usual message, for example, time 
amount assignment registration of a certain command is carried out, when it becomes applicable time amount, 
it will be a message which notifies activation of a registration command. Moreover, the "call-processing trace 
information" of a checkpoint is the information concerning the command (call-processing trace command) for 
checking the normality of telephone connection. The event number (EEV-NO) which is the response from the 
telephone switchboard to the command for checking the normality of telephone connection, a connection 
first-move number, an addresser number, etc. are contained in this "call-processing trace information." 
[0034] Next, collating result generation section 3c generates the file (collating result file) which includes a 
collating result for the result of collating and the judgment by collating section 3b for every trial item ( drawing 
8 : step S3). To drawing 1 1 , an example of a collating result file of the case at the time (those with 
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equivalency) (with no equivalency) of Collating O.K. and Collating NG is illustrated, respectively. The date etc. 
is contained in these files the collating result of trace information besides a trial item number, emergency 
message information, and monitor information and an examiner name, and as a result of a judgment (OK/NG). 
The command parameter supplied to the telephone switchboard as a collating result of trace information at 
the time of Collating NG: The error message (ERR-XX generating) to RTR (the abbreviation for route trace) is 
recorded. In addition, emergency message information and monitor information are recorded as it is simply 
discriminable. 

[0035] Next, 3d of test-result Management Department generates the test-result managed table of all trial 
items from each collating result file which collating result generation section 3c generated ( drawing 8 : step 
S4). An example of a test-result managed table is shown in drawing 12 . This test-result managed table 
consists of an item of an enforcing date the exception of the name of a trial item number and a test 
implementation person, EEV-NO (the above-mentioned event number), and OK/NG. The trial status-control 
person of the software program after modification can use this test-result managed table, and can perform a 
status control. 

[0036] In addition, the flow of operation explained above is an example, and is not limited to the flow of the 
above-mentioned processing. Moreover, the software program which recorded on the record medium which 
can computer read the software program for realizing the function of the processing section 3 in drawing 1 , 
and was recorded on this record medium may be made to read into a computer system, and the software 
program equivalency verification approach may be enforced by performing. In addition, hardware, such as OS 
and a peripheral device, shall be included with a "computer system" here. 

[0037] Moreover, "the record medium in which computer reading is possible" means storage, such as a hard 
disk built in portable media, such as a floppy (trademark) disk, a magneto-optic disk, ROM, and CD-ROM, and a 
computer system. Furthermore, the thing holding a fixed time amount software program shall also be included 
[ "whose record medium in which computer reading is possible" is ] like the volatile memory (RAM) inside the 
computer system used as a server when a software program is transmitted through communication lines, such 
as networks, such as the Internet, and the telephone line, or a client. 

[0038] Moreover, the above-mentioned software program may be transmitted to other computer systems 
through a transmission medium from the computer system which stored this software program in storage etc. 
by the carrier wave in a transmission medium. Here, the "transmission medium" which transmits a software 
program says the thing of a medium which has the function to transmit information like communication lines 
(communication wire), such as networks (communication network), such as the Internet, and the telephone 
line. Moreover, the above-mentioned software program may be for realizing a part of function mentioned 
above. Furthermore, you may be what can realize the function mentioned above in combination with the 
software program already recorded on the computer system, and the so-called patch file (difference program). 
[0039] As mentioned above, although the gestalt of implementation of this invention has been explained in full 
detail with reference to a drawing, a concrete configuration is not restricted to this operation gestalt, and the 
design of the range which does not deviate from the summary of this invention etc. is included. 
[0040] 

[Effect of the Invention] As explained to the detail, according to this invention, as mentioned above, on a 
computer system The software program before modification, and the software program after modification 
Extract predetermined information required for verification of equivalency from the test result performed 
under the same test condition, and it is based on the extract information extracted from the test result of the 
software program before said modification obtained in said test-result extract phase. The extract information 
extracted from the test result of the software program after said modification is collated for every 
predetermined trial item. Thereby, in order to check the existing function of a software program (verification of 
the equivalency of the software program before and behind modification), it becomes unnecessary to manage 
the past test result, and as for an examiner, grasp of detailed requirement specification also becomes 
unnecessary, and the time amount for it does not need him, either. That is, reduction of the activities for a 
trial and improvement in quality are realized by the autocorrelation of a test result. 
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TECHNICAL FIELD 



[Field of the Invention] This invention relates to the approach and equipment which verify the equivalency of 
the function modification before of the software program concerned, and after modification, when performing 
correction and making a change of a software program. 
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PRIOR ART 



[Description of the Prior Art] In recent years, various systems incorporating a software program are used. 
Although there is no request of a functional addition, when a program is changed in consideration of future 
maintenance nature to such a system, in order to check having not affected it out of a modification individual 
reason although the program was changed by functional addition like a rig RESSHON test (degradation trial), it 
is surely needed in the verification test of the existing function. 

[0003] On the other hand, in large systems (telephone switchboard etc.), maintenance and improvement / 
functional addition of a system etc. is repeatedly performed over a long period. Moreover, even if small-scale, 
version up is made in many cases based on the resource with which the operating system and the application 
program were created in the past. For this reason, the program is still more complicated, when the design 
technique of the program included in the system and the structure of software may change with a creation 
time term or implementers and there is a functional addition. By current, by arranging a program, development 
supporting environment is unified and reexamination of software structure is performed for the purpose of 
shortening a design and test time from these things. 

[0004] As mentioned above, when the correction and functional addition of a software program which were 
included in the system are performed, the verification test of the existing function is performed. The normality 
of the function of a software program was checked by examining based on the test procedure manual and the 
data for a trial which were carried out in the past, and conventionally, comparing this test result with the past 
test result (refer to drawing 3 (a)). 
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EFFECT OF THE INVENTION 



[Effect of the Invention] As explained to the detail, according to this invention, as mentioned above, on a 
computer system The software program before modification, and the software program after modification 
Extract predetermined information required for verification of equivalency from the test result performed 
under the same test condition, and it is based on the extract information extracted from the test result of the 
software program before said modification obtained in said test-result extract phase. The extract information 
extracted from the test result of the software program after said modification is collated for every 
predetermined trial item. Thereby, in order to check the existing function of a software program (verification of 
the equivalency of the software program before and behind modification), it becomes unnecessary to manage 
the past test result, and as for an examiner, grasp of detailed requirement specification also becomes 
unnecessary, and the time amount for it does not need him, either. That is, reduction of the activities for a 
trial and improvement in quality are realized by the autocorrelation of a test result. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, the past test result needed to be managed, and grasp of 
detailed requirement specification was needed for the check of a test result, and such an approach had taken 
most time amount. 

[0006] This invention was made in view of the above-mentioned point, can check the existing function of a 
software program automatically (verification of equivalency), and offers the software program equivalency 
verification approach and equipment which realize reduction of the activities for a trial (a human activity is 
included), and improvement in quality. 
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MEANS 



[Means for Solving the Problem] The software program equivalency verification approach of this invention In 
the software program equivalency verification approach of verifying the equivalency of the software program 
before modification, and the software program after modification on a computer system The test-result 
extract phase of extracting predetermined information required for verification of equivalency from the test 
result which performed the software program before said modification, and the software program after 
modification under the same test condition, It is characterized by including the collating phase collated with 
the extract information extracted from the test result of the software program after said modification for 
every predetermined trial item on the basis of the extract information extracted from the test result of the 
software program before said modification obtained in said test-result extract phase. 
[0008] In the software program equivalency verification approach of this invention moreover, said collating 
phase The extract information extracted from the test result of the software program after said modification 
for said every predetermined trial item It is characterized by including the phase of judging those with 
equivalency (O.K.) when it is in predetermined tolerance to the extract information extracted from the test 
result of the software program after said modification, and judging those without equivalency (NG) when there 
is nothing into predetermined tolerance. 

[0009] Moreover, in the software program equivalency verification approach of this invention, it is 
characterized by including further the collating result generation phase which generates a collating result file 
including the information as a result of the judgment in said collating phase for said every predetermined trial 
item. 

[0010] Said software program equivalency verification approach is characterized by including further the test- 
result management phase which generates the test-result managed table which recorded information including 
the quality (OK/NG) of the test result of all trial items for said every predetermined trial item based on said 
collating result file. 

[0011] The software program equivalency verification equipment of this invention In the software program 
equivalency verification equipment which verifies the equivalency of the software program before modification, 
and the software program after modification A test-result extract means to extract predetermined information 
required for verification of equivalency from the test result which performed the software program before said 
modification, and the software program after modification under the same test condition, It is based on the 
extract information extracted from the test result of the software program before said modification obtained 
with said test-result extract means. It is characterized by providing a collating means to collate with the 
extract information extracted from the test result of the software program after said modification, for every 
predetermined trial item. 

[0012] In the software program equivalency verification equipment of this invention moreover, said collating 
means The extract information extracted from the test result of the software program after said modification 
for said every predetermined trial item It is characterized by judging those with equivalency (O.K.), when it is in 
predetermined tolerance to the extract information extracted from the test result of the software program 
after said modification, and judging those without equivalency (NG) further, when there is nothing into 
predetermined tolerance. 

[0013] Moreover, the software program equivalency verification equipment of this invention is characterized by 
including further a collating result generation means to generate a collating result file including the information 
as a result of the judgment in said collating means for said every predetermined trial item. 
[0014] Moreover, the software program equivalency verification equipment of this invention is characterized by 
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including further the test-result management tool which generates the test-result managed table which 
recorded information including the quality (OK/NG) of the test result of all trial items for said every 
predetermined trial item based on said collating result file. 

[0015] Moreover, this invention is a record medium with which the software with which the equipment turns 
into equipment which performs an approach according to claim 1 to 4 was recorded and in which computer 
reading is possible by installing in a computer apparatus. 
[0016] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained with reference 
to a drawing. Drawing 1 is the block diagram showing the configuration of the equivalency verification 
equipment 1 which is the gestalt of 1 operation of the equipment which installed in the computer system the 
software program which consists of a procedure which is the gestalt of 1 operation of the software program 
equivalency verification approach of this invention, or the software program equivalency verification equipment 
of this invention. 

[0017] The outline of the software program equivalency verification approach of this invention is explained 
first. The software program equivalency verification approach of this invention uses that the same result will 
be obtained if it examines on the same conditions to the software program before and behind modification 
since there is no modification in the existing function (function in which it does not change), when performing 
modification and a functional addition of a software program. That is, if the same test condition A as the 
software program before and behind modification is inputted as shown in drawing 2 , the test result A of the 
software program before modification and the test result B of the software program after modification will use 
bringing the same result, will perform collating with a test result B by making a test result A into a reference 
value, will judge whether tolerance has a difference, and will verify equivalency of a software program. 
[0018] Contrast with the approach ( drawing 3 (b)) of verification of the equivalency of the software program 
before modification and after modification enforced in equivalency verification equipment 1 by drawing 3 and 
the conventional approach ( drawing 3 (a)) is shown. With equivalency verification equipment 1, in order to 
examine on the same conditions to the software program before and behind modification, grasp of detailed 
requirement specification becomes unnecessary by there being no need of managing the past test result, and 
collating a test result automatically. In addition, although the number of trial items for examining by the 
software program before and behind modification in verifying of the equivalency of the software program 
before modification and after modification doubles compared with the conventional approach, about this, an 
automatic trial is possible and the load of a big activity is not applied. 

[0019] With the gestalt of this operation explained below, since the information (response message etc.) from 
various testing-machine machines, the test atmosphere (workstation), etc. other than the message from a 
system is included in the actual test results A and B, it becomes difficult to compare the test result A used as 
criteria with a test result B simply. Then, the keyword appointed separately extracts data required for 
collating, and actual collating is performed using this extracted data (refer to drawing 4 ). 
[0020] Here, the configuration of equivalency verification equipment 1 is explained. Equivalency verification 
equipment 1 consists of the storage section 2 which memorizes the test result A of the software program 
before modification, and the test result B of the software program after modification, the following test-result 
extract section 3a, collating section 3b, collating result generation section 3c, and the processing section 3 
that consists of 3d of the test-result Management Department. 

[0021] Test-result extract section 3a: From the test result A of the software program before modification, and 
the test result B of the software program after modification, extract based on the keyword which can define 
predetermined information required for verification of equivalency separately, and generate the file which 
consists of extracted information. 

collating — the section — three — b — : — a test result — an extract — the section — three — a — a 
test result — A — from — extracting — having had — an extract — information — A — ' — criteria — ** - 
- carrying out — the same — a test result — B — from — extracting — having had — an extract — 
information — B — ' — collating . At this time, it collates about the checkpoint appointed separately. And 
when extract information B' judges whether it is in predetermined tolerance from extract information A' used 
as criteria and is in predetermined tolerance, those with equivalency (O.K.) are judged, and when there is 
nothing into predetermined tolerance, those without equivalency (NG) are judged. 

[0022] Collating result generation section 3c: Generate a collating result file including the information as a 
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result of the judgment by collating section 3b for every trial item. 

3d of test-result Management Department: Generate the test-result managed table which recorded 
information including the quality (OK/NG) of the test result of all trial items for every trial item based on the 
collating result file which collating result generation section 3c generated. 

[0023] In addition, the above-mentioned test result A and a test result B are the results of performing each of 
the software program before modification, and the software program after modification, and examining on the 
basis of the test condition based on the trial item defined separately, and the system of a target. Moreover, it 
changes with systems so that naturally [ predetermined tolerance ], and it defines suitably for every system to 
examine. 

[0024] Moreover, the storage section 2 is constituted by the recording device of the non-volatile of a hard 
disk, a magneto-optic disk, etc. in equivalency verification equipment 1 . Moreover, the processing section 3 
shall be constituted by memory, CPU (central processing unit), etc., and the function shall be realized by 
loading the software program (not shown) for realizing each function of the processing section 3 to memory, 
and performing it. Moreover, an input unit, a display, etc. shall be connected to equivalency verification 
equipment 1 as a peripheral device (neither is illustrated). Here, an input device means input devices, such as 
a keyboard and a mouse. A display means things, such as CRT (Cathode Ray Tube) and a liquid crystal display. 

[0025] Next, actuation of the equivalency verification equipment 1 constituted in this way is explained. 
[0026] First, based on a predetermined test procedure manual, the data for a trial predetermined in the system 
top of a target shall be used, the software program before modification and the software program after 
modification shall be performed, the test result A of the software program before modification and the 
software program test result B after modification shall be obtained, and the examiner shall memorize at the 
storage section 2 of equivalency verification equipment 1. 

[0027] The telephone switchboard should be used as the target especially in the following explanation. In this 
case, as an example of the file of the above-mentioned test result, a test-result file, a traffic data file, and a 
signal monitoring analysis file are raised. The example of contents of each above-mentioned file is shown in 
drawing 5 -7. 

[0028] First, from a test-result file, test-result extract section 3a extracts predetermined information required 
for verification of equivalency based on keywords, such as "test initiation" and "normal termination", and as a 
result of consisting of such information, it generates a file (refer to drawing 9 ). Similarly, the data file and 
monitor file which consist of predetermined information to each are generated [ data file / traffic ] from a 
signal monitoring analysis file by making "employment information" etc. into a keyword, using "MSGTYPE" etc. 
as a keyword ( drawing 8 : step S1). 

[0029] Next, in step S1, as a result of consisting of information which extracted predetermined information 
based on the keyword, from a file, a data file, and a monitor file, collating section 3b collates about the 
checkpoint shown in drawing 10 , and performs those with equivalency / nothing judgment ( drawing 8 : step 
S2). 

[0030] In the example shown in drawing 10 , two results obtained from the test result of the software program 
after modification before modification, as a checkpoint to a file, it uses "false call normal call origination", "he 
having no urgent / the maximum emergency message output", and "he having no relief of various resources", 
OK/NG is judged, and collating and a judgment are further performed by making an "independence message", 
"various data output information", and "call-processing trace information" into a checkpoint. Similarly, to a 
data file, collating and a judgment are performed by making into a checkpoint "employment information" and 
"traffic information (the time information of an incompleted call (call which was not able to be connected 
normally), a distant-office call identity number, and a local station identification number outside of an object)." 
And to a monitor file, collating and a judgment are performed again by making into a checkpoint "signal 
monitoring information (the speech path acknowledge signal, the distant-office call identity number, and the 
local station identification number outside of an object)" which is the contents of a signal which a telephone 
switchboard receives. 

[0031] In addition, although usually accessed by sending from telephone with the "false normal call origination" 
of a checkpoint to a telephone switchboard, since can prepare all the telephones to send and they cannot be 
examined, it is a checkpoint for checking that it has sent from false equipment normally (call origination) from 
creating the signal of various conditions with the false equipment equivalent to telephone, making it access to 
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the exchange, and performing a verification test. 

[0032] Moreover, since it is thought that there is a certain cause when the notice to a maintenance man when 
fault usually occurs to the condition of a telephone switchboard or connection of a telephone, saying a 
checkpoint "has no urgent / the maximum emergency message output" is and this message occurs at the 
time of test implementation, it is a checkpoint for this check. Moreover, although the resource which the 
telephone switchboard was usually performing resource management, such as various memory, saying a 
checkpoint "has no relief of various resources", caught the resource when the software program was 
performed normally, and was caught after processing termination is released, it is a checkpoint for checking 
whether a supplement and disconnection of this resource are made normally. 

[0033] Moreover, if the "independence message" of a checkpoint has some of which the maintenance man 
other than urgent / the maximum emergency message is notified as a usual message, for example, time 
amount assignment registration of a certain command is carried out, when it becomes applicable time amount, 
it will be a message which notifies activation of a registration command. Moreover, the "call-processing trace 
information" of a checkpoint is the information concerning the command (call-processing trace command) for 
checking the normality of telephone connection. The event number (EEV-NO) which is the response from the 
telephone switchboard to the command for checking the normality of telephone connection, a connection 
first-move number, an addresser number, etc. are contained in this "call-processing trace information." 
[0034] Next, collating result generation section 3c generates the file (collating result file) which includes a 
collating result for the result of collating and the judgment by collating section 3b for every trial item ( drawing 
8 : step S3). To drawing 1 1 , an example of a collating result file of the case at the time (those with 
equivalency) (with no equivalency) of Collating O.K. and Collating NG is illustrated, respectively. The date etc. 
is contained in these files the collating result of trace information besides a trial item number, emergency 
message information, and monitor information and an examiner name, and as a result of a judgment (OK/NG). 
The command parameter supplied to the telephone switchboard as a collating result of trace information at 
the time of Collating NG: The error message (ERR-XX generating) to RTR (the abbreviation for route trace) is 
recorded. In addition, emergency message information and monitor information are recorded as it is simply 
discriminable. 

[0035] Next, 3d of test-result Management Department generates the test-result managed table of all trial 
items from each collating result file which collating result generation section 3c generated ( drawing 8 : step 
S4). An example of a test-result managed table is shown in drawing 12 . This test-result managed table 
consists of an item of an enforcing date the exception of the name of a trial item number and a test 
implementation person, EEV-NO (the above-mentioned event number), and OK/NG. The trial status-control 
person of the software program after modification can use this test-result managed table, and can perform a 
status control. 

[0036] In addition, the flow of operation explained above is an example, and is not limited to the flow of the 
above-mentioned processing. Moreover, the software program which recorded on the record medium which 
can computer read the software program for realizing the function of the processing section 3 in drawing 1 , 
and was recorded on this record medium may be made to read into a computer system, and the software 
program equivalency verification approach may be enforced by performing. In addition, hardware, such as OS 
and a peripheral device, shall be included with a "computer system" here. 

[0037] Moreover, "the record medium in which computer reading is possible" means storage, such as a hard 
disk built in portable media, such as a floppy (trademark) disk, a magneto-optic disk, ROM, and CD-ROM, and a 
computer system. Furthermore, the thing holding a fixed time amount software program shall also be included 
[ "whose record medium in which computer reading is possible" is ] like the volatile memory (RAM) inside the 
computer system used as a server when a software program is transmitted through communication lines, such 
as networks, such as the Internet, and the telephone line, or a client. 

[0038] Moreover, the above-mentioned software program may be transmitted to other computer systems 
through a transmission medium from the computer system which stored this software program in storage etc. 
by the carrier wave in a transmission medium. Here, the "transmission medium" which transmits a software 
program says the thing of a medium which has the function to transmit information like communication lines 
(communication wire), such as networks (communication network), such as the Internet, and the telephone 
line. Moreover, the above-mentioned software program may be for realizing a part of function mentioned 
above. Furthermore, you may be what can realize the function mentioned above in combination with the 
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software program already recorded on the computer system, and the so-called patch file (difference program). 
[0039] As mentioned above, although the gestalt of implementation of this invention has been explained in full 
detail with reference to a drawing, a concrete configuration is not restricted to this operation gestalt, and the 
design of the range which does not deviate from the summary of this invention etc. is included. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of the equivalency verification equipment which is 
the gestalt of 1 operation of this invention. 

[Drawing 2] It is drawing explaining the software program equivalency verification approach of this invention. 
[Drawing 3] It is drawing contrasting and showing the conventional approach and the software program 
equivalency verification approach of this invention. 

[Drawing 4] It is drawing explaining the equivalency verification equipment which is the gestalt of 1 operation 
of this invention. 

[Drawing 5] It is an example of a test-result file. 
[Drawing 6] It is an example of a traffic data file. 
[Drawing 7] It is an example of a signal monitoring analysis file. 

[Drawing 8] It is the operation flow chart of the equivalency verification equipment which is the gestalt of 1 
operation of this invention. 

[Drawing 9] It is drawing showing an example of the extract file generated with the keyword applied for every 
test-result file. 

[Drawing 10] It is drawing showing an example of the checkpoint for every extract file. 
[Drawing 1 1] It is an example of a collating result file. 
[Drawing 1 2] It is an example of a test-result managed table. 
[Description of Notations] 

1 — Equivalency verification equipment 2 — Storage section 
3 — Processing section 3a — Test-result extract section 
3b — Collating section 3c — Collating result generation section 
3d — Test-result Management Department 
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DRAWINGS 



[Drawing 1] 
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